Trial application of pupillometry for a maritime usability study in field conditions

Eye-tracking is a tool employed in usability testing. It is primarily intended as a means for tracking the visual attention patterns of an observer on a continuous basis. Eye-tracking can also capture certain physiological data, such as pupil dilation. Pupil diameter is a validated metric of cognitive workload, meaning the pupil dilates with increasing workload. This research evaluates the fitness, in field conditions, of an eye-tracking based method for accurate measurement of cognitive workload. This implies evaluating the fitness of this tool in changing light conditions such as in coastal navigation. This methodology thus accounts for the effect of light on pupil dilation. This means we are able to account for the effect of only cognitive workload on the pupil dilation even in changing light conditions. This method was applied as a part of an analysis of a navigational exercise involving the navigator and the navigator’s assistant on board a training vessel of the Royal Norwegian Naval Academy. Pupillometry is used alongside egocentric video recordings and Geo-positioning systems (GPS) recordings to allow for multi-faceted evaluation of the activity. Subjective data was recorded as well to evaluate the quality of the eye-tracking data. Subjective data was recorded using NASA-TLX self-report of mental workload, self-report of mental workload (on three levels) using maps and an expert assessment of the mental workload was obtained for the navigational course. The analysis concluded that pupillometry (through eye-trackers) can have a substantial role in the evaluation of field operations and provide a good and objective estimate of the perceived workload. The eye-tracking technology has substantial limitations, for example sometimes strong infra-red sources of light can impede data collection as such with an eye-tracker, meaning the analysis is labour intensive as it relies on the ability of the operator to filter out low quality data and retain the rest

Complex Systems, Cooperative Work, and Usability

Modern operating systems are increasingly complex and require a large number of individual subsystems and procedures; operators also must cooperate to make them function. In this paper the authors consider usability from a broad perspective based on this understanding, recognizing the challenges a team of operators, complex subsystems, and other technical aspects pose as they work together. It seeks to expand usability by adding insights from Computer- Supported Cooperative Work (CSCW)-based fieldwork in offshore operations. To contribute to the current usability literature, we investigated and analyzed through a network- based approach how operators, ship bridge hardware and software, and other physical environments work together. We propose a process for evaluating the usability of complex systems: field observation and interviews to determine how work is organized and executed by human and nonhuman actors and to identify whether additional artifacts are being used to supplement the nonhuman components. The use of those artifacts often identifies usability issues in complex systems. © UPA, (2015). Reprinted from Journal of Usability Studies, VOL 10, ISS 3, May 2015, http://www.upassoc.or

Accounting for effects of variation in luminance in pupillometry for field measurements of cognitive workload

Eye-tracking is now above and beyond the sole measurement of visual attention. Amongst the multiple measures it provides, some have been explored as a measure of cognitive workload (CW). One such measure is pupil diameter. Although the relationship between pupil size and CW has been extensively documented, pupil diameter is primarily impacted by luminance variations while the cognitive workload has a relatively minor influence. Therefore luminance variations have to be accounted for, either in the experimental design or in the data processing to avoid the masking of the CW effects. This has meant that the use of pupillometry for the measurement of anything but the pupillary light response, has been restricted to highly controlled lighting conditions in a laboratory. This study proposes a new method that uses point of view (POV) video in conjunction with a luminance measurement sensor to dynamically estimate the luminance of the visual stimuli. As currently available off the shelf eye trackers are usually not equipped to record luminance variations, a luminance sensor was added to a commercial eye tracker. Eye-tracking gaze data, POV video recording of the operator/observer and a head-mounted (POV) luminance sensor together estimate the expected pupil diameter. This estimate over time is due to sole influence of luminance variations. This expected pupil diameter is used as baseline for the cognitive workload. The method was validated in laboratory conditions with controlled visual stimuli. The method reliably measures induced cognitive workload despite luminance variation.acceptedVersio

The Relationship Between Usability and Biometric Authentication in Mobile Phones

It is estimated that over 1 billion people are active mobile phone users in 2018. When using a mobile phone, there are a variety of ways to authenticate and “secure” the device, and biometric authentication is becoming an increasingly common way to do this, however, biometric authentication is not always as usable as it could be. Both usability and security are important, yet many people believe that there is a trade-off between the two. The focus of this paper was to better understand usability, computer security, and within computer security more specifically biometric authentication, and how all three can work together to create systems that are both usable and secure. A survey and interviews were conducted based on previous research to understand perceptions from the general population, usability experts, and security/biometrics experts. The results do indicate that there is indeed a perceived trade-off between usability and computer security

Accounting for effects of variation in luminance in pupillometry for field measurements of cognitive workload

Eye-tracking is now above and beyond the sole measurement of visual attention. Amongst the multiple measures it provides, some have been explored as a measure of cognitive workload (CW). One such measure is pupil diameter. Although the relationship between pupil size and CW has been extensively documented, pupil diameter is primarily impacted by luminance variations while the cognitive workload has a relatively minor influence. Therefore luminance variations have to be accounted for, either in the experimental design or in the data processing to avoid the masking of the CW effects. This has meant that the use of pupillometry for the measurement of anything but the pupillary light response, has been restricted to highly controlled lighting conditions in a laboratory. This study proposes a new method that uses point of view (POV) video in conjunction with a luminance measurement sensor to dynamically estimate the luminance of the visual stimuli. As currently available off the shelf eye trackers are usually not equipped to record luminance variations, a luminance sensor was added to a commercial eye tracker. Eye-tracking gaze data, POV video recording of the operator/observer and a head-mounted (POV) luminance sensor together estimate the expected pupil diameter. This estimate over time is due to sole influence of luminance variations. This expected pupil diameter is used as baseline for the cognitive workload. The method was validated in laboratory conditions with controlled visual stimuli. The method reliably measures induced cognitive workload despite luminance variation

Towards an understanding of operator focus using eye-tracking in safety-critical maritime settings

In this paper we report on our investigations into determining foci of attention for operators during safety-critical maritime operations, in this case a dynamic positioning (DP) operation. We monitored operators carrying out operations in ship simulators while wearing eye-tracking equipment. The eye-tracking was carried out during a standard operation with normal sea conditions (2-3 m wave height and no significant wind force). For the next iteration of experiments that will be reported in our next publication, it will then be possible to test the correlation between standard operations and operations with environmental effects introduced. These investigations led to an understanding of where operators focus, for how long and estimated their pupil dilation during these operations to investigate if it can correlate with critical parts of the operation. We also investigated the difference between trainee operators and operators with considerable experience. Results are presented along with a discussion of lessons for the design and placement of computer displays and equipment for safe operations in ship bridge environments

Accounting for effects of variation in luminancein pupillometry for field measurements ofcognitive workload

Eye-tracking is now above and beyond the sole measurement of visual attention. Amongst the multiple measures it provides, some have been explored as a measure of cognitive workload (CW). One such measure is pupil diameter. Although the relationship between pupil size and CW has been extensively documented, pupil diameter is primarily impacted by luminance variations while the cognitive workload has a relatively minor influence. Therefore luminance variations have to be accounted for, either in the experimental design or in the data processing to avoid the masking of the CW effects. This has meant that the use of pupillometry for the measurement of anything but the pupillary light response, has been restricted to highly controlled lighting conditions in a laboratory. This study proposes a new method that uses point of view (POV) video in conjunction with a luminance measurement sensor to dynamically estimate the luminance of the visual stimuli. As currently available off the shelf eye trackers are usually not equipped to record luminance variations, a luminance sensor was added to a commercial eye tracker. Eye-tracking gaze data, POV video recording of the operator/observer and a head-mounted (POV) luminance sensor together estimate the expected pupil diameter. This estimate over time is due to sole influence of luminance variations. This expected pupil diameter is used as baseline for the cognitive workload. The method was validated in laboratory conditions with controlled visual stimuli. The method reliably measures induced cognitive workload despite luminance variation

Trial application of pupillometry for a maritime usability study in field conditions

Eye-tracking is a tool employed in usability testing. It is primarily intended as a means for tracking the visual attention patterns of an observer on a continuous basis. Eye-tracking can also capture certain physiological data, such as pupil dilation. Pupil diameter is a validated metric of cognitive workload, meaning the pupil dilates with increasing workload. This research evaluates the fitness, in field conditions, of an eye-tracking based method for accurate measurement of cognitive workload. This implies evaluating the fitness of this tool in changing light conditions such as in coastal navigation. This methodology thus accounts for the effect of light on pupil dilation. This means we are able to account for the effect of only cognitive workload on the pupil dilation even in changing light conditions. This method was applied as a part of an analysis of a navigational exercise involving the navigator and the navigator’s assistant on board a training vessel of the Royal Norwegian Naval Academy. Pupillometry is used alongside egocentric video recordings and Geo-positioning systems (GPS) recordings to allow for multi-faceted evaluation of the activity. Subjective data was recorded as well to evaluate the quality of the eyetracking data. Subjective data was recorded using NASA-TLX self report of mental workload, self-report of mental workload (on three levels) using maps and an expert assessment of the mental workload was obtained for the navigational course. The analysis concluded that pupillometry (through eye-trackers) can have a substantial role in the evaluation of field operations, and provide a good and objective estimate of the perceived workload. The eyetracking technology has substantial limitations, for example sometimes strong infra-red sources of light can impede data collection as such with an eye-tracker, meaning the analysis is labour intensive as it relies on the ability of the operator to filter out low quality data and retain the rest

Trial application of pupillometry for a maritime usability study in field conditions

Eye-tracking is a tool employed in usability testing. It is primarily intended as a means for tracking the visual attention patterns of an observer on a continuous basis. Eye-tracking can also capture certain physiological data, such as pupil dilation. Pupil diameter is a validated metric of cognitive workload, meaning the pupil dilates with increasing workload. This research evaluates the fitness, in field conditions, of an eye-tracking based method for accurate measurement of cognitive workload. This implies evaluating the fitness of this tool in changing light conditions such as in coastal navigation. This methodology thus accounts for the effect of light on pupil dilation. This means we are able to account for the effect of only cognitive workload on the pupil dilation even in changing light conditions. This method was applied as a part of an analysis of a navigational exercise involving the navigator and the navigator’s assistant on board a training vessel of the Royal Norwegian Naval Academy. Pupillometry is used alongside egocentric video recordings and Geo-positioning systems (GPS) recordings to allow for multi-faceted evaluation of the activity. Subjective data was recorded as well to evaluate the quality of the eye-tracking data. Subjective data was recorded using NASA-TLX self-report of mental workload, self-report of mental workload (on three levels) using maps and an expert assessment of the mental workload was obtained for the navigational course. The analysis concluded that pupillometry (through eye-trackers) can have a substantial role in the evaluation of field operations and provide a good and objective estimate of the perceived workload. The eye-tracking technology has substantial limitations, for example sometimes strong infra-red sources of light can impede data collection as such with an eye-tracker, meaning the analysis is labour intensive as it relies on the ability of the operator to filter out low quality data and retain the rest